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I. INTRODUCTION 

In the brane world scenario [1,2] our universe is assumed to be a submanifold, or brane, 
embedded in a higher dimensional bulk space time. In contrast with the traditional Kaluza 
- Klein [3] treatment of extra - dimensions, ordinary matter fields are confined on the brane, 
only gravity can propagate into the bulk. In particular, the scenario proposed by Randall and 
Sundrum [4], consists of a single positive tension brane which is embedded in the five dimensional 
anti- de Sitter ( i.e. A = — , l is curvature radius of bulk ) space ( AdS§ ) with Z 2 - symmetry 

( the RS2 scenario [4] ). However one may neglect the cosmological constant in AD brane ( 
i.e. A 4 = 0 ) by choosing RS fine tuning condition. It is well known that the cosmological field 
equations on the brane are essentially different from the standard 4 - dimensional cosmology 
[5]. In RS2 scenario, the modified Friedmann equations give H oc px at early stages of the 
evolution of the universe when the energy density is high ( i.e. pt A ) and the standard four 
dimensional gravity is recovered on the brane in the low energy limit [4,6,7] (i.e. H oc yfpr when 
Pt ^ A ). 

Recent observations [8-14] suggest that our universe is currently undergoing an accelerating 
expansion. This challenging issue in standard cosmology shows a new imbalance in the gov¬ 
erning Friedmann equations. Physicists have addressed such imbalances by either introducing 
new sources or by altering the governing equations. In the frame of standard cosmology, this 
imbalance is addressed by introducing a new matter source termed as dark energy (DE) in the 
Friedmann equations. However the nature of DE is completely unknown ( except for its negative 
pressure ) and is still an unresolved problem in modern cosmology [15,16]. On the other hand, 
a group of physicists have explored the second possibility and modified the gravity theory itself, 
assuming that at large scales, Einstein’s theory of general relativity breaks down and a more 
general action describes the gravitational fields. These theories include f(R)- gravity, Scalar 
tensor gravity, Einstein-Gauss-Bonnet gravity, Brane world gravity and many others [2,4,15-21]. 
In particular, brane world scenario is related to gravity in higher dimension and matter fields 
are confined to the brane. In the frame work of RS2 model, several models have shown the 
recent observed phenomena, specifically a self-interacting scalar field [22-26] behaves as dark 
energy. The dynamics of scalar field with constant or exponential [27] as well as self-interaction 
potential [28] has been studied in the context of FRW cosmology. Also scalar field coupled to 
barotropic fluid has been found in [29-35]. Further, it should be mentioned that scalar field 
appears naturally in particle physics and in the present context it behaves as a source of DE. 
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The aim of this paper is to investigate the dynamics of RS2 brane scenario in the context 
of interacting dark species. The dark energy (DE) is chosen as a real scalar field with self 
interacting potentials while a perfect fluid model with barotropic equation of state is taken as 
a model for dark matter (DM). The argument behind choice of interaction models is that they 
are favoured by observed data obtained from the Cosmic Microwave Background (CMB) [36] 
and matter distribution at large scales [37]. Further, Das et al [38] and Amendola et al [39] 
showed that an interaction model of the universe mimics the observationally measured phantom 
equation of state as compared to non-interacting models, which may predict a non phantom 
type of equation of state. 

As the evolution equations in the brane scenario are very complicated in form so exact 
analytical solution is not possible for the present model. Hence a dynamical system analysis 
in the phase space associated to this scenario is presented. To study the nature of the critical 
points, eigenvalues of the first order perturbation matrix near the critical points are examined. 
Also classical stability analysis for the model is done. In this context, relevant dynamical system 
studies in the brane scenario can be found in [40-43] and others. 

The paper is organized as follows : Section II comprises of the essential details of Randall - 
Sundrum model and deals with basic equations in Brane Scenario and formation of Dynamical 
System. In Sections III a detailed phase space analysis related to the critical points is presented, 
we discuss the existence and stability / instability of critical points as well as of the model in 
section IV. Finally, the discussion and concluding remarks are given in section V. Throughout 
the paper we use natural units ( 8nG = = h = c = 1 ). 

m PL 


II. BASIC EQUATIONS IN BRANE SCENARIO AND FORMATION OF 

DYNAMICAL SYSTEM 


In the framework of RS2 brane model two dark species interacting non-gravitationally are 
considered in the background of flat FRW model. One of the dark species namely the dark 
matter is considered in the form of perfect fluid with barotropic equation of state while the 
other dark component namely the dark energy (DE) is chosen as real scalar field with arbitrary 
self interaction potential. So the modified Einstein field equations are [44-47] 


H 


2 _ 1 n , P T \ i 

~ 3 Pt(1 + 2A } + X 


(1) 
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2 H — —(1 + ^-)(</> 2 + UmPm ) -( 2 ) 

Where A is brane tension, oj m is barotropic index of the dark matter, px = p m + p<p is the 
total energy density of the dark species. Here U(t) = is the dark radiation term which 
arises due to non- zero bulk Weyl tensor and C is constant parameter related to the black hole 
mass in the bulk. If the bulk is chosen as AdS- Schwarzschild then C/ 0 [45] while C vanishes 
[47,48] for AdS bulk. For simplicity of calculation in the present work we shall choose the later 
bulk model so that (7 = 0 . 

It should be noted that we have neglected the cosmological constant in the 4D brane ( i.e. 
A 4 = 0 ) by choosing Randall-Sundrum fine tuning condition. The energy conservation equations 
for individual dark sectors are given by 

Pm T ^>Huj m p m — Q (3) 


and 


p<t> + 3 H (p^ +P 0 ) = -Q 


( 4 ) 


where Q stands for the interaction between the two dark species ( i.e. dark matter and dark 
energy ). For the time being Q is unspecified only it is assumed that Q does not change sign 
during the cosmic evolution. In the above continuity equation (3) p m is the energy density for 
dark matter and is related to the thermodynamic pressure by the relation p m = (ui m — 1 )p m , 
where to m is the barotropic state parameter bounded by the relation 0 < oj m < 2. However, oj m 
should be very close to unity, and even greater, nor less than 1 , in order to satisfy the usual 
energy conditions imposed for dark matter. On the other hand, the energy density and pressure 
of the scalar field cj) are given by 

P4> = \4> 2 + - V'(^) (5) 


with V((j)) as the self interacting potential. Now using (5) in the continuity equation (4) the 
evolution of the scalar field is given by 


(j> + 3 Hcj) + 


dV((j)) 

d(f> 



( 6 ) 


At the early stages of the evolution of the universe the energy density is high ( i.e. px 3> A ) so 
from the modified Friedmann equation (1) H oc px- On the other hand, at late times, due to 
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expansion the energy density of the matter falls off so that pr -C A and we have H oc y / pr i.e. 
the equation (1) behaves as the usual Friedmann equation at late stages of the evolution. Thus, 
although the brane effects are dominant at early epochs but the modified Friedmann equation 
(1) describes the evolution of the universe at all times. 

Moreover due to complicated form of the evolution equations namely equations (1), (2), (3) 
and (6), it is not possible to have an analytic solution. Hence for a qualitative idea about 
the cosmological behavior we shall put the evolution equations into an autonomous dynamical 
system. For this, we introduce the new variables 

_ v _ Pt m 

■' y/6H ,V 3 H 2,Z 6XH 2 (7) 

which are normalized over Hubble scale. As a result, the evolution equations reduce to the 
following autonomous system of ordinary differential equations ( after some algebra ) 


dx 

dN 


3 3 ,(1 + 2;) 3 (l + z) (1 — x 2 — y — z) 

-ys — 3x H—x 3 --(2 — oj m ) H— xu m ( 1 — y — z)- -- — a- - 

2 y 2 (l-z) v ; 2 1 \l -z) 2x 

= - V6xys + 3y ^ + [x 2 (2 - u m ) +u; m ( 1 - y - z)] 

dz 

— = -3z[x 2 (2 - Um) + Wm(l ~ V ~ *)] 

m = “ v/5 ” 2/(s) 


(8) 


where we have introduced another dynamical variable related to the self interacting potential of 
the scalar field as 


1 dV 
V~d4> 


with 


m = v 


d 2 V 

dtp' 2. 


(dV _\2 
1 dp > 


1 


and the independent variable is chosen as N = In a. 


(9) 


( 10 ) 


In deriving the above autonomous system of ordinary differential equation we choose the 
interaction to be in the form Q = aHp m , with a as the coupling parameter. Usually, in the 
literature a is chosen to be positive. This indicates that there is energy flow from DE to DM, as 
required to alleviate the coincidence problem and to satisfy the second law of thermodynamics. 
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Hence in view of coincidence problem, the positive coupling is very reassuring. On the other 
hand, for negative coupling parameter there is decay of DM into DE. Such models allow for the 
possibility that there is no DE field in the very early universe and that DE ’Condenses’ as a result 
of the slow decay of DM [49]. Also recently, it has been shown [50] that the coupling parameter is 
weakly constrained to negative values by Planck measurements. However, the negative coupling 
can not be counted to resolve the tension between the Planck and HST measurements of the 
Hubble parameter [50]. Although, the negative coupling does not help to alleviate the coincidence 
problem, it appears in the observed data fittings that models with negative coupling show most 
significant departure from zero coupling. 

Moreover, from the view point of curvature perturbation, it has been shown that[51] when 
the interaction is proportional to the DE energy density, we get a stable curvature perturbation 
( except ujfj, = — 1 ) while for the choice of the interaction proportional to DM energy density 
or total energy density of the dark sectors, the curvature perturbation can only be stable when 

< — 1 ( Ucf, is the equation of state parameter for DE ). 


Further, using the normalized variables into the first modified Friedmann equation, we obtain 
the density parameter for the dark matter as 

VL m = l-x 2 -y-z (11) 


Due to the energy condition 0 < < 1, the normalized variables are not independent but are 

restricted by the relation 

Q<x 2 + y + z<l (12) 


Also the ratio of the total energy density to the brane tension is given by 


PT _ 2 z 

A (1 -z) 


(13) 


From the above relation we see that the early super dense region (p? A) i.e. neighborhood 
of initial singularity corresponds to ^ = 1 while z = 0 indicates late time cosmological solution 
when pt ^ A ( i.e. low energy regime ). But the explicit form of the autonomous system 
shows that z = 1 is not allowed by the system i.e. our model is not appropriate to describe the 
dynamics near the initial singularity ( possibly quantum effects will be appropriate ). However, 
from mathematical point of view the neighborhood of this initial singularity may be reached in 
the limiting sense ( i.e. asymptotically ). Thus the phase space of the above autonomous system 
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can be described as 


tips = \{x,y,z) x {«}] 


(14) 


With 0<x 2 + y + z<l, — l<x<l,0<y<l,0<z<l and s € 3ft . Further, the 
cosmological parameters related to the scalar field namely the equation of state parameter ( 

) and the density parameter can be expressed by the newly defined variables as 


P<f> x -V n P<p 2 , 


(15) 


Also the deceleration parameter has the explicit form 


H _ 3,1 + z sr 2 , 


Q = - 1 - ~F 7 ^ = ~ 1+ 0(7 - )i x ( 2 - Urn) ± W m ( 1 -y- z)\ 

2 1 — z 


(16) 


III. CRITICAL POINTS AND PHASE -SPACE ANALYSIS : 

The system of equations (8) forming an autonomous dynamical system has the following 
eleven critical points, which can be classified as : 

I. Critical points : P\ , P 2 = (±1,0,0, 0), P$ = (0,1,0, 0) 

II. Curves of Critical Points : P3 = (x c , 0,0,0), ±4, ±5 = (±1,0,0, s c ), 

Pr = (0,1~ z,z€ [ 0 , 1 ), 0 ) 


III. Classes of Critical points : ±6 = (x c , 0,0, s c ) , Pg = (0, 0,1, s) , 

D / 3ui m cx 2as ± (3uj m ex) (2 w m ) 
no = (— 7 =—,-ft-, 0 ,s c ) 




6s%uj m 


and 




where s c is a solution of f(s) = 0 and x 2 = — 3 ( 2 -lj ) • Note that as 0 < u m < 2 so for the 
existence of the critical points P 3 and Pq we must have ui m < 2 and a < 0. In other words, the 








TABLE I. Table shows the location of the critical points and the value of the relevant physical parameters 
of those points of the autonomous system (8). 
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fluid should not be ultra relativistic stiff fluid and the energy exchange should be in the reverse 
way for the critical points P 3 and Pq to exist. 

These critical points and relevant physical parameters at those points are shown in table I. 

In the table q c = — 1 + ^(3u; m — a). We see from the table that the critical points Pi, P 2 , 
P4, P5, P7, Ps and Pg always exist while P3 and Pq will exist for x 2 < 1 i.e. co m < 2 + 
Further the classes of critical points P 10 will exist for s 2 > 3cj m — a, 0 < u m < 2 and for the 
coupling parameter a > 0. These are the combination of both DE and DM and there will be 
an acceleration near P 10 for 3w m — a < 2. Another class of critical points Pu will exist for 
s 2 c < 6 , completely DE dominated solutions and acceleration will occur near these points when 
s 2 < 2. Also, the four critical points Pi, P2, P4 and P5 represent only the DE component ( 
DM is absent ) while P3 and Pq correspond to a combination of DM and DE with the ratio 
of two energy densities r = 1- f c . Note that for the first six critical points (Pi - Pq ) the DE 
behaves as stiff fluid while for the critical points P7 and Ps the DE represents cosmological 
constant (A CDM model) and the DE corresponding to the critical points P 10 and Pu is perfect 
fluid in nature. However for the critical point Pg we can not have any conclusion about the 
DE. For the two critical points P3 and Pq the perfect fluid representing the DM may have any 
equation of state. Although the four critical points Pi, P2, P4 and P5 correspond to DE only 
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Vector field and Trajectories for autonomous system (8) 



FIG. 1. Phase space of the system (8) for the choices of ( 
a = 0.01, com = 1.01 ,0 = 1, x = — 1 ) for the self interaction 
potential V = (l7+exp ^ x0)) , . 


Vector field and Trajectories for autonomous system (8) 



FIG. 2. Phase portrait of the system (8) for the choices of 
a = 0.01 , u>m = 1.01 , /? = —1, x = —1 for the self interaction 
potential 1/ = ( , +exp ^ x0)) . 


but still in the brane scenario there will be deceleration only, while the critical points P 3 and Pq 
represent a combination of DM and DE and there will be acceleration if u> m < Figures 

1- 5 show the phase portrait ( in 2D and 3D ) of the system ( 8 ) for the self interaction potential 
I r = f° r different choices of the parameters involved. In this connection, it should 

be mentioned that a similar phase space analysis with exponential potential on the brane has 
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Trajectories for autonomous system (8) 



FIG. 3. figure shows the the critical points Pi and P 2 represent 
the unstable node in the (x, y) phase plane for a = 0.1 and 
u> m = 1.01 while the point Pg represents the late time attractor 
inflationary de Sitter FRW solution . 



FIG. 4. 3D figure of the system ( 8 ) for the choices of a = 0.01 
and uim = 1.03 shows that the curve of the critical points P 7 is 
a potential energy dominated attractor solution in the space. 


been done by Goheer et al [52,53 ]. 
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FIG. 5. Figure of (x, y , z) of the system (8) for the choices of 
a = 0.1 and w m = 1.1 



FIG. 6. Figure of ( x,y,z ) of the autonomous system (17) for 
the choices of a = 1.1 and w m = 1.03 


A. Another Interaction model 


If we choose the Interaction term of the above ’interacting DE in the brane scenario’ as 
Q = aHpfy , where a. is coupling parameter. The evolution equations reduce to the following 
autonomous system for this case : 
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FIG. 7. 3D figure of of the autonomous system (17) for the 
choices of a = —1.5 and = 1.01 


dx 

dN 


3 m 3 

—ys — 6x H— X 

T 2 


dy 

dN 


o(l + z),„ . 3 , . (1 + z) (x 2 + y) 

(T=1) (2 “ Wm) + 2 Xa;m( ” y _ z) (T^) " “ 2x 

-V&xys + 3j/ || ^ [ x 2 (2 - cu m ) +w m (l - y - z)\ 

dz 

— 3z[x (2 w m ) -|- cu m (l y z)] 


dTV 


dN 


= —VE xs 2 f(s) 


(17) 


The critical points of the autonomous system (17) and the corresponding physical parameters 
are given in the table II: 

From Table II, we see that the critical points C± and C 2 for the autonomous system (17) are 
same in all respect. They will exist for a < 0 and 0 < oj m < 2. They are combination of both 
DE and DM and are always dominated by the kinetic energy of the scalar field. There will be 
an accelerating phase of the universe near these critical points for a < —4. On the other hand, 
the critical point C 3 is completely matter dominated solution (p rn = 3 H 2 ) ( see table II ) and 
are in accelerating phase for u m < |. Phase portrait of the autonomous system (17) are shown 
in figures 6 and 7 for different choices of the parameters involved. 
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TABLE II. Table shows the location of the critical points of autonomous system (17) and the values of 
the relevant physical parameters of those points. 
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IV. STABILITY ANALYSIS 

In this section, we shall investigate both the stability of the equilibrium points as well as the 
stability of the present model in two different subsections. 

A. Equilibrium points and Stability criteria 

We shall now discuss the stability of the critical points ( presented in table I ) of the au¬ 
tonomous system (8), considering first order perturbations near the critical points. To examine 
the nature of critical points, one has to study the eigenvalues of the first order perturbation 
matrix which has been presented in table III. 


The first two critical points P\, P 2 are identical in all respects. Both are non-hyperbolic 
critical points but they behave like a saddle point in the phase space of the RS model because 
they have a non empty stable and unstable manifolds. These critical points represent solutions 
without matter part and are dominated by the kinetic energy of the usual scalar field. 

The line of critical point x = x c ( P3 ) represents a solution which is a combination of both 
DM and DE. If | x c | is very close to unity then the solution is dominated by DE ( i.e. the 
scalar held ) while if x c is very close to zero then it represents a DM dominated solution. It 
corresponds to a solution in accelerating or decelerating phase provided cu m sg ^4^. It is a l so 
non-hyperbolic in nature. However, it behaves like a saddle point in the phase space as it has a 
non empty stable and unstable manifolds. 
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TABLE III. Eigenvalues of the linearized matrix for the critical points of the autonomous system (8). 
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The critical point P4 is essentially a line of critical point s = s c which are solutions dominated 
by the kinetic energy of the scalar field. These critical points are hyperbolic having saddle - 
like nature due to instability in the eigen direction associated with a positive eigenvalue and the 
stability of an eigen direction associated to a negative eigenvalue. 

P5 is another line of critical points characterized by s = s c and has the same features as P4. 
Analyzing the eigenvalues we see that it is also hyperbolic saddle type critical points. 

Lastly, we have classes of critical points denoted by Pq. Its corresponding solution is a 
mixture of DM and DE. However, depending on the choice of uj m the solution may be in 
accelerated phase or in deceleration era. These hyperbolic critical points will be stable if 
ui m < min( ^ + 2 , ^ + ^|x c s c ) and x c f'(s c ) > 0 , otherwise they will be saddle in nature. 
Note that in the stable case there may or may not be acceleration depending on x c s c sg 
However, if <n m > max( ^ + 2, ^ + ij^x c s c ) and x c f'(s c ) < 0 then eigenvalues are positive and 
fixed points correspond to unstable solution. 

However, depending on the choice of parameters involved we have the following criteria 


x c f'(s c ) > 0,-1 < g < y | x c s c — 1 , the stable manifold is of dimension three and the system 
is restricted by the phantom barrier. Further, if the phantom region is allowed i.e. q < — 1 then 
stable manifold is of dimension two. Moreover, if s c < 0 and x c f{s c ) < 0 then all eigenvalues 
are positive and fixed points correspond to unstable solution. 
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TABLE IV. Condition for stability at each equilibrium point of the autonomous system (8). 
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The above results can be summarized as follows : 

• For a > 0, the non-hyperbolic solutions P\ and P 2 (in table I) are always unstable in the 
phase space and are in complete kinetic energy domination, are always decelerating (q = 2) ( 
see fig. 1,2 and 3 ). 

• For a < 0 and t o m < 2, the curves of critical points P 3 are non-hyperbolic and have both 
combination of DE and DM and are always unstable (saddle) in the phase space. There will be 
an acceleration of the universe near the points P 3 if oj m < 
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• For a > 0, the hyperbolic solutions P 4 and P 5 (see table I) are unstable in the phase 

space. Though they are completely DE (kinetic energy of the scalar field ) dominated but only 
deceleration (q = 2) possible. See fig. 1 for a = 0.01 , u m = 1.01, (3 = 1, x = — 1 and potential 
V = (, l+c V p(- x ,h))iJ ■ the point P 4 is saddle node where as P 5 is unstable node in the phase space. 
On the other hand, for a = 0.01, oj m = 1-01, /3 = —1, x = — 1 and potential V = > 

the point P 4 is saddle node and P 5 is unstable node (see fig. 2 and tables I and III). 

• For a < 0 and uj m < 2, the classes of critical points P§ are hyperbolic and combination 
of both DE and DM components. There will be an accelerated universe near Pq if uj m < ^4^. 
These are the conditionally stable in the phase space. 

• The solutions with 5D corrections in the brane scenario (singularities in the autonomous 

system ( 8 )) namely Pj, Ps and P 9 always exist. It should be mentioned that these singular 
points are similar to those in ref. [54 ] and the analysis is very similar to it. The de Sitter 
like solution (w^ = — 1 ) P 7 (see table I) is dominated by the potential energy of the scalar field 
(pr = V and p m = 0 ) and is always in accelerating phase. Here potential much larger than 
brane tension i.e. k>A, so, Hrs = - 7 =- So that the early time (high energy) expansion rate 
in the Randall-Sundrum model Hrs gets enhanced with respect to the general relativity rate 
Hgr '■ = \J~^\ an d this is the kinetic energy dominated non-hyperbolic solution and has 

2D stable manifold for a < 6 , otherwise it is unstable node in the phase space ( see 3D fig. 4 
and 5 ). 

• The point P% is particular case of Pj (in table I). Ps is non-hyperbolic in nature and has 2D 
stable subspace for a < 6 . In particular, Ps corresponds to a late time attractor and de Sitter 
FRW solution (3 H 2 = V ) (see figure 3). 

• Pg is the kinetic energy dominated solution (pr = yr) which is also a saddle point for 
(3 lo + j < 3), non-hyperbolic in phase space. At first sight this is an unexpected result since 
in standard general relativity, the kinetic energy dominated solution is always a source ( past 
attractor ) in phase space. However, a closer inspection of the RS model reveals that this point 
belongs in the high energy phase, which is the one that is modified by the brane contribution, 
hence it is not such an unexpected result; five dimensional contributions modify the structure 
of the phase space at high energies. 

• For s 2 c > 3cu m — a, 0 < uj m < 2 and a > 0 the points Pro correspond to a combination of 
both DE and DM components and are hyperbolic in nature but may be non-hyperbolic for some 
choices of the parameters involved in the eigenvalues of corresponding critical points (see table 
III). The points will be stable in the phase space for 2 as 2 < (3w m — a) 2 (2 — u m ), 3a i m > ol and 
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s c /'Oc) > 0 otherwise they have stable manifold of dimension less than four (table III) . There 

will be an acceleration of the universe near Pio for 3u; m — a < 2. 

• Finally, for s 2 < 6, the classes of critical points P\ \ are completely DE ( scalar held, = 1 

) dominated solutions (see table I) and will be stable in the phase space of the Brane Scenario 
2 

for a < 3 — 4^(3 — u m ) and s c f'{s c ) > 0 (see table III). There exists an accelerating phase of 
the universe near P\ \ for s 2 < 2. P\ \ are hyperbolic in nature in the phase space but for some 
choices of s c in table III they may behave like non-hyperbolic. Also it should be mentioned that 
the classes of critical points Pio and P\\ are similar to critical points Pj and Ps in ref. [54]. 


B. Stability of the model 

In the present four dimensional autonomous system ( 8 ), the local stability criteria of an 
equilibrium point is characterized by the eigenvalues of the perturbation matrix ( presented in 
table III ) and discussion about local stability is presented in last subsection. We shall now 
investigate the classical stability of the model. 

In cosmological perturbation, sound speed ( C s ) has a crucial role in characterizing classical 
stability. In fact, C 2 appears as a coefficient of the term K ( k is the comoving momentum and 
’a ’is the usual scale factor ) and classical fluctuations may be considered to be stable when C 2 
is positive[55,56] . This may prevent (to some extend) instability due to the presence of negative 
energy ghost states. In the present cosmological scenario we have 


ci = i - 


2 \/ 6 xys 


6 x 2 + a( 1 — x 2 — y — z) 


so for classical stability 


6 x 2 + a(l — x 2 — y — z) > 2\/6 xys 


(18) 


We have shown classical stability criteria of the model by the inequality (18). We shall now 
discuss about the criteria for the model stability at the equilibrium points ( presented in table 
I ) when x, y, z and s take the corresponding values of equilibrium points. From the tables 
I and III we see that the equilibrium points Pi and P 2 are not locally stable ( saddle ) and 
from the above model stability analysis they correspond to classical stability. The equilibrium 
point P 3 ( see table I ) corresponds to classical stability if a > but it is not locally stable. 
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From the tables I and III we see that two equilibrium points P 4 and P 5 are not locally stable 
( saddle ) but from the above analysis we see that they are classical stable. The points P7, 
Pg and Pg correspond to classical stability (limiting). The classes of critical points P10 and 
Pn are classical stable conditionally (see table IV) as well as they are locally stable (see table 
III) which have been discussed earlier. Finally, the classes of critical points Pq locally stable if 
uj m < min( + 2 , ^ + '\J~^x c s c ) and x c f'{s c ) > 0 which have been discussed earlier where as for 
classical stability they behave same as the equilibrium point P 3 . The corresponding condition 
for stability at each equilibrium point are presented in table IV. 


V. DISCUSSION AND CONCLUDING REMARKS 

The present work deals with an explicit phase space analysis of the cosmological scenario 
in RS2 model. In the perspective of recent observational evidences, the matter is chosen in 
the form of interacting DE and DM. For DM, perfect fluid with barotropic equation of state is 
taken while real scalar field with self interacting potential is the candidate for DE. The relevant 
critical points of evolution equations ( which are hyperbolic or non-hyperbolic in nature ) and 
the values of the physical parameters at those points are presented in table I and table II for 
two type of interactions namely Q oc p m and Q oc p^ respectively. The local stability of the 
equilibrium points are analyzed by examining the eigenvalues (presented in table III) of the 
linearized matrix. The classical stability of the system near the equilibrium points are discussed 
in section IV and the condition for classical stability is presented in the inequality (18). The 
self interacting potential for the scalar field (taken as DE) is chosen as V((j>) = ( ^ + . . 

From the autonomous system ( 8 ) we have obtained two sets of critical points for different 
choices of the coupling parameter of the interaction term ( discussed in section III ). A wide 
class of self interaction potentials (DE) for which the quantity /(s) = — 1 can be written 

as a function of variable s = — (where the primes denote differentiation with respect to 1 ^ ) 
are included in this study. For the self-interaction potential V{(j>) = (, l+ev l"_ x( t ,))0 > the function 
f(s) is given by f(s) = ^ + 7 [57] and the zero of this function is s c = —fix- The phase portrait 
of system ( 8 ) for this potential are shown in figures 1 and 2 . 

From the study we see that the critical points Pi, P2, P3, P4 and P5 (hyperbolic or non- 
hyperbolic) are saddle type having union of nonempty stable and unstable manifolds. The 
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critical points Pi, P2, P4 and P5 are the solutions dominated by kinetic energy of the scalar 
field but they correspond to decelerating phase ( q = 2 ). There are some restrictions on Lo m 
for accelerating or decelerating phase of the universe near the critical points P3 and Pq. Also, 
we obtained the restrictions on uj m for which the classes of critical points Pq will be stable by 
analyzing the eigenvalues of the linearized perturbed matrix. The critical points P7, Pg and 
Pg are non-hyperbolic in nature, among them P7 and Ps have stable subspace of dimension 2 
( for a < 6 ) in the phase space and there always exist accelerating phase of the universe near 
these points. The kinetic energy dominated solution Pg is unstable in the phase space. Further, 
classes of critical points P10 and Pn are conditionally stable (see table III). Also in table II we 
have presented the critical points for the interaction Q oc and as the critical points are very 
similar so we have not discussed it further. 


Moreover, we have investigated the classical stability of the model. Note that these two 
type of stability are not interrelated because the stability of a critical point is related to the 
perturbations ( linear stability ) of corresponding point variables ( x, y, z and s ). On the other 
hand, the classical stability of the model is connected to the perturbations 5 p ( and depends on 
the condition Cg > 0 ). From the table IV, we conclude that the critical points can be classified 
into three categories namely 

(i) unstable points at which model is stable, 

(ii) stable points at which model is unstable and 

(iii) stable points with stable model. 


The four critical points Pi, P2, P4 and P5 are classical stable where as P7, Pg and Pg corre¬ 
spond to classically limiting stable and the equilibrium points P10 and Pn are both classically 
conditionally stable. The critical point Pg and the classes of critical points Pq , P 10 and Pn 
are interesting from cosmological point of view. Imposing some restrictions on the independent 
parameters they will be stable points as well as correspond to stable model ( see table IV ) and 
describe late time acceleration for matter in the form of interacting dark energy. 
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